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METHOD AND DEVICE FOR OPERATING AN INDICATING UNIT ON A WORKING 

MACHINE 

BACKGROUND OF THE INVENTION 
Field of the invention 

[0002] The invention relates to a method for operation of a 
pointing unit on a process machine, and to a pointing unit on a 
process machine, as claimed in the precharacterizing clauses of 
patent claims 1 and 16. 

Related Art of the Invention 

[0003] Process machines are frequently used in industry for 
manufacturing purposes and for logistics tasks. The range in this 
case extends from machines with fixed programs via unmanned 
transport systems on tracks to autonomous systems which 
automatically orient themselves with respect to their surrounding 
area. In the past, process machines such as these have, 
frequently, however, carried out only repetitive tasks, which can 
be predicted within limits. In this case, there is no direct 
interaction with people who are involved in the process sequence. 
It is therefore often very difficult for people who are located 
in the immediate vicinity of the process machines only at times 
to become involved in the regular process sequence of a process 
machine. It is also difficult to identify changes carried out 
automatically to the process sequence and, for example, a change 
to the process sequence may be required owing to unexpected 
disturbances . 

[0004] The Japanese patent application with the publication 
number JP 2000089163 discloses a pointing appliance by means of 
which it is possible to point to sought objects which are 
contained in video sequences. An object is in this case selected 
by means of a search term which is predetermined by the user. The 
search term can be entered in the pointing appliance by means of 
voice control, for example. In this case, an image which contains 
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SUMMARY OF THE INVENTION 
[0009] The invention is based on the object of providing a novel 
method for operation of a pointing unit on a process machine, as 
well as a process machine having a pointing device for carrying 
out the method as claimed in the precharacterizing clauses of 
patent claims 1 and 16, which makes it possible to communicate 
with people and/or with other process machines. 

[00010] According to the invention, the object is achieved by a 
method and a pointing unit having the features of patent claims 1 
and 16. Advantageous refinements and developments of the 
invention are described in the dependent claims. 

[00011] According to the invention, a process machine is operated 
in conjunction with sensors. In this case, the sensors are used 
to dynamically record the area surrounding the process machine, 
with object identification being carried out by means of a 
computer unit on the basis of the detection of the surrounding 
area Obstructions detected during the object identification in 
the working area of the process machine are taken into account 
and cause the process machine to be switched off or the process 
sequence to be reorganized/replanned. The process machine is now 
provided in an inventive manner with a pointing unit which is 
used for setting up optical communication between the process 
machine and/or other process machines. For this purpose, the 
pointing unit comprises an illumination unit, by means of which 
patterns are deliberately projected onto objects which are 
located in the area surrounding the process machine, for optical 
communication. 

[00012] The invention for the first time makes it possible to 
deliberately indicate objects in advance in the working area of 
the process machine. People and/or other process machines which 
are located in the area surrounding the process machine can thus 
intervene in the process sequence in good time and, by way of 
example, can correct or even prevent any disturbances. The 
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invention also makes it possible to indicate the process sequence 
of the process machine per se, deliberately in its surrounding 
area. The projection of patterns onto objects allows people to 
tell very quickly which objects and other process machines are 
currently involved in the process sequence and what steps should 
be carried out next. This considerably simplifies not only 
interactions between people and the process machine, but also 
between cooperating process machines. 

[00013] The objects may be obstructions which are located in the 
working area of the process machine. The advanced indication of 
obstructions means that it is not absolutely essential to switch 
off the process machine immediately. This advanced indication of 
obstructions also means that it is not essential to 
reorganize/replan the process sequence. For example, people or 
other process machines can still remove obstructions from the 
working area in good time before the process machine reacts 
automatically to them and, for example, reorganizes the process 
sequence. It is also feasible for the objects to be objects which 
are related to the process sequence of the process machine. 
Advanced indication of the next objects to be manipulated allows 
people or other process machines to interact with the process 
machine in a simple manner. For example, someone can hand a 
process machine precisely that object which is indicated by it, 
and this also applies in a corresponding manner to other process 
machines; another process machine, for example, produces an 
object exactly at the position indicated by the process machine, 
and this also applies in a corresponding manner to people. 

[00014] In one advantageous embodiment of the invention, it is 
also feasible to use a laser beam for the projection of patterns. 
Galvanometer scanners are particularly suitable for this purpose, 
and allow the laser beam to be projected very quickly and with 
very high position accuracy. Galvanometer scanners can be 
controlled by means of a computer-controlled deflection unit, so 
that the patterns to be projected may have any desired shape. 
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[00015] It is also possible by the alternative use of an 
illumination unit which operates in conjunction with an array of 
optical lenses to project patterns with any desired extent onto 
the objects. By way of example, an illumination means having a 
fiber-coupled lens array may be used as the optical illumination 
unit. In the same way, it is also feasible to use illumination 
means which are known from automobile engineering for the 
purposes of the invention, in which the shape and intensity of 
the light beam of a spotlight or headlight can be varied. Such 
illumination is intended to be used to avoid dazzling the drivers 
of oncoming vehicles, and to illuminate the curves better when 
turning. The international patent application WO 98/54030 
proposes various forms for the configuration of such illumination 
means, based on the example of a vehicle spotlight or headlight. 

[00016] It is also feasible for the illumination unit to be an 
illumination unit which is already intended for other purposes in 
conjunction with the process machine. For example, process 
machines frequently use illumination sources to indicate the 
direction in which they are traveling. The use of the same 
illumination source for different purposes on the one hand saves 
costs and on the other hand consumes less electrical power, which 
is particularly advantageous in the case of process machines 
powered by rechargeable batteries. 

[00017] The method according to the invention allows patterns 
with any desired shapes to be projected in a general form. 
However, it has been found to be particularly advantageous to 
project patterns which are in this case in the form of defined 
symbolic representations. Geometric shapes such as circles, 
triangles etc. are particularly suitable, by way of example, and 
it is also feasible to project script characters or numbers. It 
is thus possible to associate a unique pattern with each process 
machine for projection. People or other process machines can thus 
more easily associate the projected patterns with that particular 
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process machine. 

[00018] The unique association of the patterns with a process 
machine may, however, also be achieved by the use of different 
blinking frequencies for projection. 

[00019] It is also feasible for the patterns to be projected to 
extend completely over that surface of the object which is 
visible from the viewing direction of the process machine, and 
thus to be identified at a glance. 

[00020] In addition, it has also been proven for the patterns to 
be projected only onto a portion of the surface of the object 
which is visible from the viewing direction of the process 
machine. Specific information can thus be projected at positions 
being looked for (for example the left upper corner) on the 
object surface. 

[00021] In a further advantageous refinement of the invention, it 
has been proven for the patterns to be projected in a blinking 
form. Particularly in the case of very bright objects or 
structured projection surfaces, blinking projection of the 
patterns can be seen more clearly than continuous projection 
against the background. A blinking representation of a pattern 
may, however, also advantageously be linked to a particular event 
occurring in the area surrounding the process machine. For 
example, when the rechargeable battery in a process machine is 
virtually discharged. The blinking frequency can also be varied 
dynamically. For example, once an obstruction has been identified 
in the process sequence, it is possible to initially illuminate 
this continuously. If the obstruction is not removed, the process 
machine then starts to replan the process sequence. Until the 
amended process sequence is actually continued, the pattern is 
represented using an increasing blinking frequency. A means which 
allows the respective light source to be operated in a pulsed 
form can be provided for this purpose, depending on the chosen 
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light source. 

[00022] It is also feasible to automatically vary the intensity 
of the illumination on the basis of changing environmental 
conditions. A change in the environmental conditions can indicate 
that the background lighting resulting from daylight is changing. 
However, external light sources which vary on the basis of 
production processes (for example in the case of welding) , or 
changing light sources on other process machines can be 
compensated for well by automatically varying the intensity of 
the illumination. A further significant point is a change in the 
condition of the projection surface, so that the color or the 
structure of the surface to which the pointing unit is pointing 
may differ at different points. Such differences can be 
compensated for particularly well by automatic variation of the 
illumination intensity. In this context, a further means can be 
provided by means of which such changes in the environmental 
conditions can be detected, in particular, with cameras or photo- 
elements being particularly suitable for this purpose. 

[00023] In a further advantageous refinement of the invention, 
light at different wavelengths is used for illumination. If two 
or more autonomous process machines are working in the same area, 
then each process machine may be allocated a separate wavelength, 
in order to distinguish better between them. In this case, the 
wavelengths should be chosen such that their difference is 
ideally more than 50 nm so that the wavelength band which is 
visible to a human observer can be subdivided into a large number 
of colors which can still be clearly distinguished. 

[00024] In particular, it has been proven for the illumination to 
use light in the non-visible wavelength range, in particular in 
the infrared. This makes it possible reliably indicate the 
process sequences of different autonomous systems, thus 
minimizing the influences of the environmental lighting. For this 
purpose, each autonomous system is preferably allocated one fixed 
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wavelength in the infrared band. The wavelengths for the 
respective machines may in this case be very close to one 
another, so that one wavelength can be uniquely allocated for a 
large number of process machines. 

[00025] It has also been proven for the illumination source to be 
switched on and off in order to illuminate the working area, 
taking account of environmental conditions. Particularly when no 
people or any other autonomous systems are located in the area 
surrounding the process machine, it is worthwhile switching off 
the illumination means used for projection, thus saving energy. 

[00026] The illumination means which have been mentioned in 
conjunction with the pointing unit in some cases have restricted 
emission angles and can thus not emit light over the entire area 
around a process machine. In a further advantageous refinement of 
the invention, an additional means is therefore provided, in 
order to automatically change the position and/or the orientation 
of the illumination unit on the process machine. For the first 
time, this makes it possible to cover the entire area around a 
process machine, even when using illumination sources with narrow 
beams . 

[00027] The invention can also be used in a particularly 
advantageous manner in conjunction with mobile process machines, 
in particular driverless transport systems. This allows 
interactions between people and a process machine as well as 
between cooperating process machines to be considerably 
simplified even in complex industrial scenarios. 
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